Expert appraisals are a well known technique used to evaluate comprehension and task problems in questionnaires. Used for this purpose a classification system based on the cognitive steps that a respondent normally runs through is applied. The classification system names well known problems with the wording, tasks or response categories in questions. It is recommended that at least three censors first make their individual evaluations and then come together to work out joint conclusions. We have constructed a different classification system, but have nevertheless used a similar technique to evaluate two business web survey applications. Our expert appraisals are a part of a project guided by a conceptual model that links together the instrument and data collection procedure developed and presented to the respondent, the characteristics of the respondent and his environment, and the outcome of the response process. At present we test various methods of measuring the different elements of this model separately, but eventually the plan is of course also to analyze the relationships between different parts of the model. The expert appraisal procedure is used as one way of evaluating the quality of the first element of the model, namely the data collection instrument in web surveys. In Norway two main portals are presently used to collect information from companies. First it is the System for Information and Data Exchange with Businesses (Idun), which is a portal developed for statistical questionnaires by Statistics Norway. Secondly it is the Altinn portal that has been developed by the Tax Authorities, The Brønnøysund Registers and Statistics Norway, with the ambition to offer one common web portal to all official institutions that collect data from companies or private persons. There are both similarities and differences in the structure and design of these two applications. For about a year ago a current best practice publication named “Advise for development and design of web questionnaires”was written. The content was partly based on tests run during the development of Idun and Altinn, but first of all based on international research. We have used the recommendations given in this publication to classify possible problems in web survey applications. Then a few expert appraisals of Idun and Altinn questionnaires were carried out with the help of this classification system. We tried to run the evaluations according to the procedure recommended in classical expert appraisals. In our presentation we first want to introduce the classification system itself, because it mirrors what we think is the current best way of designing business web survey applications. Secondly we would like to show some the results from the appraisals that we think are interesting. And finally we want to discuss if it is this or other methods that should be used to evaluate the design element in our conceptual model.